paul smith is set to face andre ward in oakland , california on june 20 .
liverpool fighter is not expected to challenge for ward 's wba world title .
smith has lost back-to-back world title challenges against arthur abraham while the american is undefeated in 27 games .